Improving the Accessibility of Line Graphs in Multimodal Documents
نویسندگان
چکیده
This paper describes our work on improving access to the content of multimodal documents containing line graphs in popular media for people with visual impairments. We provide an overview of our implemented system, including our method for recognizing and conveying the intended message of a line graph. The textual description of the graphic generated by our system is presented at the most relevant point in the document. We also describe ongoing work into obtaining additional propositions that elaborate on the intended message, and examine the potential benefits of analyzing the text and graphical content together in order to extend our system to produce summaries of entire multimodal documents.
منابع مشابه
Assistive Multimodal Interfaces for Improving Web Accessibility
Multimodal interfaces have been used in helping blind and partially sighted people to access visualization tools such as graphs and numerical tables. However, few studies have been undertaken to improve Web access and navigation using a multimodal approach. This paper describes a novel approach that addresses this Web accessibility issue by using an assistive tool which consists of a multimodal...
متن کاملProcessing Information Graphics in Multimodal Documents
Information graphics, such as bar charts, grouped bar charts, and line graphs, are an important component of multimodal documents and cannot be ignored. When such graphics appear in popular media, such as magazines and newspapers, they generally have an intended message. We argue that this message represents a brief summary of the graphic’s high-level content, and thus can serve as the basis fo...
متن کاملDecision Tree Induction for Identifying Trends in Line Graphs
Information graphics (such as bar charts and line graphs) in popular media generally convey a message. This paper presents our approach to a significant problem in extending our message recognition system to line graphs — namely, the segmentation of the graph into a sequence of visually distinguishable trends. We use decision tree induction on attributes derived from statistical tests and featu...
متن کاملCausal Inference in Graph-Text Constellations: Designing Verbally Annotated Graphs**Supported in part by DFG (German Science Foundation) in ITRG 1247 ‘Cross-modal Interaction in Natural and Artificial Cognitive Systems’ (CI-NACS)
Multimodal documents combining language and graphs are wide-spread in print media as well as in electronic media. One of the most important tasks to be solved in comprehending graph-text combinations is construction of causal chains among the meaning entities provided by modalities. In this study we focus on the role of annotation position and shape of graph lines in simple line graphs on causa...
متن کاملToward Extractive Summarization of Multimodal Documents
Summarization research has focused on text, and relatively little attention has been given to the summarization of multimodal documents. If extractive summarization techniques are to be used on multimodal documents containing information graphics (bar charts, line graphs, etc.), then a strategy must be devised both for extracting the high-level content of the information graphics and for identi...
متن کامل